MULTIMEDIA SYSTEM AND METHOD FOR REMOTE MONITORING OR 
REFEREEING IN AMUSEMENT MACHINES 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

This invention is related to the field of coin operated (coin-op) amusement 
machines. In particular, the invention relates to a system and method which 
comprises a plurality of amusement machines (i.e., video games, flipper games, 
pinball machines, prize dispensing games, arcade games, electronic darts, kiddie 
rides, pool tables, golf games, basketball games, billiards, redemption games, 
soccer tables, shuffle board alleys and bowling alleys, touch-screen countertop 
games and the like) equipped with play components and associated means to 
capture multimedia information based on the performance of the players at the 
machines, means to transmit the multimedia information captured from the 
machines to a network, and a processor based machine (e.g., a central processing 
unit (CPU)) for managing and storing this multimedia information. 



2. Description of the Prior Art 

A good number of coin-op amusement machines with means to capture 
data on the games and players and of connecting to a network, such as a LAN or 
a WAN (e.g., the Internet), are currently known. 

For example, European Patent EP 697,579, to Bozkaya, discloses a dart 
board with means to display the result of a darts game. The board is equipped 
with an instant camera, which permits immediately determination the winner of a 
game, as a photograph is taken when the dartboard is hit or a determined score is 
reached and displays the photograph of the winning player. 

German Patent DE-A-43 14 145 discloses a system for playing in several 
dart game amusement machines. In particular, the system includes slot 
machines, remotely installed in relation to one another, with at least two game 
machines installed in different places, with a bidirectional connecting line between 
the game machines, different disks subdivided in sectors to receive the darts, a 
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device to record and indicate the position of the impacts on the disk and a 
computer to process, evaluate and transmit the data. 

European Patent EP 752,089, of NSM AG, discloses a similar system, 
wherein a number of transmitter and receiver components, rigidly arranged outside 
5 the disk, whose connecting lines form a grid and are interlaced by a dart that hits 

the disk, coordinates being assigned to the grids. The values of the co-ordinates 
where the dart impacts are transmitted to other machines via modem and a data 
telecommunication line. The system is provided with a computer connected by the 
line to process, evaluate and transmit the data and a screen to display the results. 

10 U.S. Patent No. 5,593,349 to Miguel et a/., discloses a league and 

tournament system which includes a centralized league machine which transmits 
data to one or more of a plurality of darts machines via modem or using the 
wireless portable data storage device. The information from the electronic darts 
machines can be transmitted via MODEM, by facsimile transmission or using the 

15 portable data storage device. The darts machines are configured to receive and 

use the information from the database on the league and tournament for a variety 
of purposes, including the automatic implementation of player handicaps, the 
automatic control of play, and recording the team and player who are using the 
dart machine. The machine has a monitor which displays context sensitive menus 

20 using information from the data base. 

In the art there, therefore, exists the possibility that players may play 
games or participate in leagues in different locations, connected to one another 
and to a computer by telecommunications lines. In particular, the Internet or other 
computer network may be used to communicate, and the data and results from the 
25 games may be recorded in a computer and transmitted to the machines. 

Furthermore, in the sub set of amusement machines known as video 
games, it is typically the system that imposes and enforces the rules. For 
example, video game systems are typically closed, and there is little possibility of 
cheating, as the system software prevents it because the entire game is played on 
30 the machine in a controlled, closed loop. 



On the contrary, in amusement machines that comprise games or sports 
machines, such as darts, snooker, golf, basketball machines, etc., part of the 



action is performed independent of the machine. In these scenarios, the system is 
incapable of detecting all possible infringements of the game rules and regulations 
or possible cheating by the players outside the system control capabilities. For 
this and other types of amusement machines, the current systems and methods 
5 do not provide optimal systems and methods for controlling and discerning the 

validity of the play, or if play and players abide by the rules. This is a practical 
drawback when one wants to carry out global competitions in different parts of the 
planet. Other drawbacks also exist. 



1 0 DESCRIPTION OF THE INVENTION 



An object of the present invention is to provide a management system and 
method for amusement machines, located either in substantially the same location 
or at a remote location with respect to one another. The system and method is 
15 applicable to any type of amusement machines, whether sports machines (e.g., 

darts, etc.) or otherwise. 

Another object the invention is to provide a method to manage the 
refereeing of the games played on amusement machines wherein a human or 
non-human referee can make decisions at a remote site. Monitoring or Refereeing 
20 may occur in real time or with a time delay, based, at least in part, on multimedia 

information captured from the amusement machines which may communicate over 
a network such as the Internet. Accordingly, the system and method enables 
game play to be monitored and refereed, cheating to be reduced and enhances 
fair competition in games and between players. 

These and other objects may be achieved by providing a system and method 
comprising amusement machines that further comprise multimedia information and 
data capturing means. For example, multimedia information capturing means may 
comprise imaging devices (e.g., digital or analog cameras or video recorders), 
auditory recording devices (e.g., digital or analog sound recorders) and other devices 
that capture the images and sounds of the players and the play as it develops during 
a game. Other data capturing devices, such as score boards, impact sensors (e.g., 
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for darts, shooting or golf games), distance measuring devices, or other appropriate 
sensors as dictated by the particular requirements of the game or sport to be played. 

The system and method further provides with one or more monitoring or 
refereeing centers. The monitoring or refereeing centers may receive the multimedia 
information and other data from the amusement machines. The multimedia 
information and other data may be transmitted over a network (e.g., a LAN, WAN, 
the Internet, a wireless network, a cellular network, etc.) to an appropriate receiving 
device (e.g., monitors, computers, speakers, etc.) at the refereeing center. The 
refereeing center may be located anywhere that is accessible via the network 
including remote locations. Monitoring or refereeing may occur either substantially 
instantaneously (e.g., in real time) or at a later time (e.g., with a time delay). 

The system and method also comprises implementing computer-assisted 
refereeing means. For example, a luminous source of visible light (e.g., a laser, or 
other visible light beam) may be used to project lines, boundaries, or other limits of 
the area of play (e.g., a place where the player is to stand, or the like). Other 
computer assisted sensors (e.g., speed monitoring devices), out-of-bounds sensors 
(e.g., pressure transducers or the like) and the multimedia information capturing 
devices may be input into a computer or other processor-based device (e.g., laptop, 
personal digital assistant (PDA), special purpose monitoring station, or the like) in 
order to assist an evaluation of whether game play or player conduct conforms to the 
rules of the particular game. 

The monitoring or refereeing centers may be a "call center" for a game 
promoter and conveniently comprise monitors to monitor the state of development of 
the games on the amusement machines from the data located on the network. In 
25 addition, information from the amusement machines may be stored or otherwise 

archived at the monitoring or refereeing centers. 

The refereeing center and the amusement machines may also comprise a 
multimedia telecommunications system. For example, microphones, speakers, 
video monitors and cameras may be incorporated into the amusement machines 
30 and the refereeing centers. With the telecommunication system, the referee can 

observe the entire game environment and all the incidents that may arise during 
each game. The refereeing decisions can be made known at any point of play 
and be appealed, interactively, between players and the refereeing centers. 
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In some embodiments, the refereeing center may comprise an optical 
surveillance system, incorporated in each machine, and a local (LAN) or wide area 
(WAN) network telecommunication system. In addition, a surveillance system in 
each machine comprise a video camera or cameras, with filters, reflective 
5 elements and electronic equipment, which simultaneously capture images from 

different sources, with varied, changing lighting. 

In some embodiments, the refereeing center or amusement machine may 
incorporate auxiliary electronic elements that automatically detect situations of 
play that contravene the rules or regulations of play applicable in each case. For 
10 example, auxiliary electronic devices may vary depending on whether the 

amusement machines are darts, snooker, golf machines, eta, thus, facilitating the 
referee's job. For example, these elements may perform a function similar to that 
of the ball detectors used in modern tennis courts to indicate whether a serve has 
entered in the regulatory area or not. 

15 The remote refereeing system and method may be assisted by a computer 

system that permits selectively storing sequences of images that record the 
complete development of the games, so that the referee can determine, at any 
time, if the players have respected the rules of play or if, on the contrary, they 
have committed infringements. 

20 The information can be transmitted by a local computer network or by 

Internet, via cable, wire, satellite or wireless mechanisms. In any case, a 
dedicated computer program permits analyzing and managing the multimedia data 
from the machines, as well as transmitting multimedia data thereto. The referee's 
decisions are included in this multimedia data. 

25 The telecommunication system permits establishing an interactive 

multimedia conferencing between the players and the referee. For example, a 
conference may be conducted if a player wishes to contest a referee's decision. 

As will be appreciated by those skilled in the art, the system of this 
invention permits playing individual or team competitions on a global scale, 
30 wherein the games are played with efficient supervision of all incidents of play, as 

it includes the game environment in the system. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The invention is explained in detail further on and by way of non-restrictive 
example, referring to the accompanying drawings in which: 

Fig. 1 illustrates a side elevational view of a darts machine and the area of play 
according to the present invention. 

Fig. 2 is a top plan view of the machine and the area of play of Fig. 1 . 

Fig. 3 illustrates a front elevational view of the machine of Fig. 1 . 

Fig. 4 illustrates a block diagram example for the remote refereeing system in a 
local network. 

Fig. 5 illustrates a block diagram example for a remote refereeing system via a 
network such as the Internet. 

DETAILED DESCRIPTION OF THE INVENTION 

Through the drawings, the same numerical references indicate similar or 
1 5 corresponding elements or components. 

Hereunder, a particular embodiment applicable to electronic amusement 
machines and darts games will be described, although everything stated here is 
also applicable, mutatis mutandis, to other types of amusement machines. 

In this embodiment, the remote monitoring or refereeing system for 
20 amusement machines of the present invention is based on a plurality of amusement 

machines, specifically darts machines 1 , equipped with play components with means 
to capture data of the full sequence of the play and on the results of the players at 
the machines (e.g., by detecting the impact and its place of impact on the dartboard) 
and means for transmitting the data captured in the machines to a network. 

25 The darts machine 1 comprises a structure or housing 3, a dartboard 4, an 

interface panel 5 to enter data with a keyboard 30 and a microphone 31 , and a panel 
6 for a coin slot or other analogous payment elements. The darts machine 1 also 
comprises a digital video camera 7, a monitor 8 and a visible light emitter 9. 
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The monitor 8 can be any known type, in particular TFT, and its screen is 
preferably positioned in the upper part of the unit, protruding with respect to the front 
principal plane of the machine 1 with a certain gradient with respect to the vertical 
plane, which means the player 13 can better view the images transmitted. 

5 The digital video camera 7 is equipped with filters, reflective elements and 

electronic equipment, and can simultaneously capture images from different 
sources and with varied, changing lighting. The camera 7 may have any suitable 
field of view appropriate for the conditions of the game. For example, dashed line 
33 indicates one possible field of view. 

1 0 The visible light emitted by the emitter 9 is preferably laser light and describes 

a luminous beam 10 which traces a throw line 12 on the floor 11, which marks the 
minimum regulatory distance of the position of the player 13 who is throwing the dart 
14. 

Each machine 1 of the system consists of a processor based device, e.g., 
15 CPU 15, wherein the multimedia data of the game is stored, and an output line 16 to 

communications network 17, 17'. The network may consist of a WAN, e.g., the 
Internet 17 (Fig. 5) or a LAN 17' (Fig. 4) or other network (e.g., wireless, cellular, 
satellite, etc. (not shown)). 

The digital video camera 7 captures the motion image of the traced line 12 
20 and an image recognition system in the CPU 15 detects if the player 13 crosses the 

line 12. 

If it is a LAN 17 s , the machine will be connected to this network via a general 
purpose application server 18. If it is a WAN 17, the connection can be made 
through an Internet Service Provider (ISP) 28, the machines being connected 
25 through a local network Hub 20 and a Proxy PC 21 , or through a ADSL router 22, or 

a modem 23. 

In Fig. 5 we see that the network 17 is the Internet, different remote locations 
or games rooms 24, 25, 26, 27 can be connected to the network through different 
devices. 



30 



The system comprises at least one monitoring or refereeing center 2 for the 
data located in the network of arrays of the machines 1, likewise being possibly 
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connected to the network through an ISP 28, for instant or delayed refereeing. The 
system works with at least an application server, likewise connecting to the network 
17. 

Each darts machine 1 and monitoring or refereeing center 2 are equipped 
5 with communication components or camera interface 7, monitor 8, keyboard 30 and 

microphone 31. The monitoring or refereeing centers 2 are also equipped with 
analogous communication components. 

The monitoring or refereeing centers 2 can therefore monitor the state of 
development of the games in the machines 1 from the multimedia data located in the 
10 network 17, 17\ 

The refereeing method according to some embodiments of the invention is as 
follows. For each machine 1 of an array of machines on the network 17, 17\ if the 
player 13 complies with certain conditions of play, during the play, the capturing 
means of the machine 1 capture the development of the play and the video camera 7 
15 records the image of the area of play and of the player 13, throughout the entire 

development of play. 

The results and image data are immediately transmitted or stored in the 
machine computer system 15, and when they are called up by the monitoring or 
refereeing centers 2, the results and image data are recovered from the network 17, 
20 17', stored and viewed by a referee 32 located in a center 2. 

The referee 32 decides if the games selected have been played without 
infringing the rules of play, and the results of the portions of play and the winning 
player data are transmitted via the communication channel to the network 17, 17' and 
to the corresponding machines 1 according to the refereed competition. In the 
25 present example, a darts competition, the winning player(s) and the winning player 

data are displayed on the machines 1 . 

To decide on the results of the winning games, the referee 32 will make the 
validation based on the image data transmitted to the monitoring or refereeing center 
2. 

30 Optionally, a player can send a multimedia signal to the referee from a 

machine 1 to the monitoring or refereeing center 2, indicating an objection to the 
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referee's decision, using the keyboard 30 and the microphone 31 to contact the 
referee 32 in real time or leave a message of objection. Based on this multimedia 
signal, the referee 32 decides, instantly or with time delay, on a final ruling on this 
objection, which he communicates to the network. 

According to the invention, the refereeing of the results and winning portions 
of play is done immediately or with time delay. In this way, players in different 
locations can participate in a game when they desire and the referee can validate the 
results. For example, a player in Europe can participate at 10:00 a.m. in a game and 
a player in the USA, 8 hours later, and the referee give the result at 10:00 a.m. USA 
time. 

Although it is foreseen that the referee is a human operator 32, the 
invention covers the possibility that the referee is an automatic or computer aided 
control. 

The abovementioned merely illustrates the principles of the invention, 
Consequently, it will be appreciated that those skilled in the art can design 
different arrangements which, although they have not been explicitly shown or 
described herein, likewise incorporate the principles of the invention and are within 
its spirit and scope. In this sense, depending on the characteristics of the game, 
the data capturing means will adopt different forms. For example, in the case of 
billiards or snooker games, the video camera 7 can focus on the whole game table 
and sensors determine the hole in which the ball enters and the number of 
caroms. 
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